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ABSTRACT 

The purpose of this investigation was to assess the 
effects of behavioral objectives and criterion evaluation upon the 
classroom progress of adolescents. Classroom behavior and academic 
achievement were examined within the experinental settina. In 
assessing the importance of this study, consideration was given to 
classroom behavior and achievement of disruptive students, teacher 
expectations, and modifications of instructional techniques. Two 
eighth grade teachers participated, and 22 students were subjects. 
Four observers and one grader recorded data daily. The teachers were 
trained to write behavioral objectives and to employ criterion 
evaluation during treatment conditions. Analyses of variance showed 
significant differences in classroom behavior and in achievement. It 
was concluded that the use of behavioral objectives and criterion 
evaluation had a positive effect on the classroom progress of 
adolescents. It was also concluded that the process of remediation 
expanded the opportunity for learners to reach prespecified goals. 
(Author/Bw) 
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EFFECTS OF THE USE OF BEHAVIORAL OBJECTIVES AND CRilERION 


EVALUATION UPON THE CLASSROOM PROGRESS OF ADOLESCENTS 


A. Bert Webb, Marshail University 


William H. Cormier, University of Tennessee 


The purpose of this investigation was to assess the eftects of 
behavioral objectives and criterion evaiuation upon the classroom 
progress of adolescents. Two eighth grade teachers participated, and 
22 students were the subjects. Four observers and one grader recorded 
data daily. The teachers were trained to write behavioral objectives 
and to employ criterion evaiuation during treatment conditions. 
Analyses of variance showed significant differences in ciassroom be- 
havior and in achievement. it was concluded tnat the use of behavioral 
objectives and criterion evaluation had a positive effect on the 


classroom progress of adolescents. 


EFFECTS OF THE USE OF BEHAVIORAL OButvLTIivE>s AND CRITERIUN 


EVALUATION UPON THE CLASSROOM PROGRES» O: ADGLESLENTS 


A. Bert Webp, Marshaii University 


William H. Cormier, University of Tennessee 


A great dea! has been written about the merits of Dehaviorai 
objectives for classroom instructicn. Ever since the pubiicat?on or 
Mager’s Preparing Instructional Objectives (1962), many cure cuiuin 
leaders, curriculum developers, programmers, and classruom teacners have 
prepared and used behavioral objectives. A’so, several researchers have 
investigated the effects of behaviorai objectives on learning (Smitn, 
19673; Engel, 1968; Cook, 1969; Baker, !969; and Jenkins and Dens, 1971;, 
in all of these studies, the investigators assessed tne ettects of 
merely establishing the behaviora! opject ves ‘n writing as a function 
of the instructional procedures. Criterion achievement tests were used 
to assess the effectiveness of the objectives. None of the above 
studies provided the opportunity for the subjects to remediate; that is, 
none of the previous studies was des: gned to provide :earners an cppor- 
tunity to re-engage in iearning activities atter deficiencies nad been 


detected. 


The primary purpose of this investigation was to study the effects 
of behavioral opjectives and criterion evaluation upon the c.assroom 
progress of adolescents. Classroom behavior and academic achievement 
were examined within the experimentai setting. {fn assess ng the im- 


portance of this study, corsidevation was given to classroom behavior 
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and achievement of disruptive Students, teacher expectations, ana mudi- 


fications of instructional techniques. 


METHOD 


Subjects 

The subjects of this investigation were selected from four eignth 
grade generai mathematics ctasseas in a junior nigh schoo:. Most of the 
subjects came from rural homes which were on a iower to middie socio- 
economic levei. Two mathematics teachers, one male and one remaie, 
participated in the study. Each teacher selected two classes and 
identified the six most disruptive students in eacn ciass- Jne sud~ 
jects for ali four classes included 16 male and six fema‘e a.sruptive 
students.* The California Tests scores indicated that for this group 
of disruptive students the IQ scores ranged trom 73 to i13 witn a 
mean of 94. Group scores for mathematics achievement, based on the 
California Tests, revealed the following: range, third grade=second 
month (2.2) to ninth grade-ninth month (9.9); median acn:evement, 


sixth grade-sixth month (6.6;. 
PROCEDURE 


Categories of Behavior 


The foliowing categories of classroom behav:or were used: 
Task Relevant (TR). Task relevant behavior included answering or 


asking questions which were lesson-oriented, writing or reading when 


*Two of the criginal twenty-four students moved away during tne 
progress of the investigation. 
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directed to do so, hand raising to get the teacher's atlerit.on, oking 
at the teacher while he is lecturing, looking at anotner itudent who 15 
participating in lesson activity, and any other behavior which ‘s cone 
sistent with the ongoing ciassroom activity, lask Reievant aiso ‘nciuded 
talking, laughing, or just sitting at one’s desk when students had not 
been instructed to engage in lesson activity ana wnen these behaviors 
were not forbidden by the teacner or were not impolite in nature, e.g., 
taking an object away from someone, hitting someone, 

Time Off Task (70). This category inciuded just sitting et one's 
desk without appropriate materials or without attempting to get ap- 
propriate materiais. it was fooking at nori=lesson mater.a:i, gazing out 
the window, or looking around the ryvom when lesson act vity nad been 
assigned. The subject, however, was not distracting anyone eise by his 
inattention. 

Disruptive Behavior (DB). A rating of DB indicated that the suo- 
ject had exhibited some behavior which disrupted the academic per- 
fcmance of another student. For exampie, motor behaviors were such 
behaviors as getting out of one’s seat, standing up, walking acound, 
rocking in one's chair, moving the cnair, gesturing without ta:k-ng, 
showing an object without talking, tapping another student to get nis 
attention, throwing objects, or any other disruptive movement without 
noise. Also, tapping feet, ciapping nands, tearing papers, tapping one's 


pencil on the desk, or any other nonverbal no'se-producing benav or wh°ch 


was not directly involved in TR was rated as DB. Aggressive behaviors 
such as hitting, pushing, shoving, pinching, s:aoping, poking witn 
objects, gravbing objects from another student, and destroying objects 


were rated as DB. 
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Observation and Recording 

Observers used a iU-second time-sampiing procedure tu record the 
above categories of classroom behav or. Ihe observer kept ns eyes on 
the second hand of a stopwatch untii the end of a iO<Securd t me inter- 
val, and then he tooked up at the subject he was observing and +ecoraed 
the behavior he observed. The observer then returned nis eyes to the 
watch and kept tnem there unt*i the end of tne next i0-se.und interval. 
The observers were cauttoned tu recurd oniy one category of Dehavior 
during a 10-second interva!. Eatn subject was ubdséerved for a total of 
six-minutes ser class pericd. However, the opserver recorded the be-=- 
haviors of one subject for one-minute and tnen observed another subject 
for one-minute until all six subjects were observed, Tne observer 
repeated the cycie of observing each subject tor one-minute six times. 


The sequence for observing the subjects was random for eacn cycle. 


Observer Training and Reliab: i ty 

The observers were instructed that they must be aware of ciassroom 
procedures, in order to know that behavior was appropriate for a given 
Situation. For example, the teacher mey nave arivwed taiking after 
students had tintshed their assignments. if tne obdservers were not 
aware Of such a Situation, they nay have recorded tne suodyect's be-~ 
havior incorrectiy,. Observers were aiso inst»ucted not to :nteract 
with either pupils or teacher white in the classroom. Tney were re- 
peatediy reminded to remain a5 ufudtrus:¥e a5 possic.e while in the 
classes. The observers were not infurmed about tne purpose of tne study 


or when changes in the experimentai conditions occurred. 


oe Sabana dtl ie 
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Reiiability testing sessions Ss Mu-ated Une ectual Ciassruom sose- = 
vation process which was described above Videoltaces of aitual ciass 
sessions were used. As the observers watched the videotape, they re- 
corded the classroom benaviors of designated pupil: tor a mencmum ot 18 
minutes, or (08 iO-second intervals. At the end of the reilan’ ity 
testing session, aii data sneets were checked tor agreement ot ratings. 
If all ratings were not tne same at a given intervai, then agreement was 
not evident and the interval was counted .ncorrect. The incorrect 
ratings of all observers were then tadu:eted. if the combined incorrect 
ratings of the observers did not exceed 15 percent of the total numoer 
of behaviors recorded, tnen an acceptabie ievei ct reliability was con- 
sidered acceptabie. if, however, the tota! number or incorrect 
responses was more than 15 percent of tne total! score, then further 
training and review were given. foilow:ng the rev ew sessiun, anotner 
reliability test utilizing a new videotape was given, Une test for 
observer reliability was conducted during eacn uf ine four exper mental 
conditions of the tnvestigation. After the train:na sessions, ooserver 
reliability was established at .88; the Tour subsequent sess.ons 


yielded reliability scores of ,93, .95, -96, anda .95 


Grader. 

In an attempt to insure impartiaiiiy .f @vaiueting the sudjects, 
all academic classroom work was scored by a trained grader. ihe par= 
ticipating teachers did not grade any acaaemic mater.ai or test. Tne 
grader was an experienced teacher who had a background in mathematics, 
and who was not employed at the site otf the Investigation. Cssentially, 


the grader: (1) evaiuated the work of the subjects accora.ng to tne 
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criteria established by the previously distributed benavicra’ objectives, 
and (2) scored tests which were administered auring the invest gation. 
For exampie, pre and posttests administered during Condition Two were 
scored by the grader. Also, the grader scored the tests given du-ing the 
four conditions of the study. In this manner, an attempt was made to 
eliminate teacher bias in assignment of grades. Ihe grader was not toid 
the purpose of the study or when changes in the experimental conditions 


occurred. 


Teacher Training 


After the second week of Condition One, both teachers were given 
instruction in writing behavioral objectives and in developing 
criterion-referenced measuring tests. They were then requested to pre- 
pare behavioral objectives for one unit which would account tur 
approximately three weeks of the study and one covering about two weeks 
of work. The behavioral objectives were written so that a new set could 
be distributed to the students each day. The investigator examined 
each set of behavioral objectives for clarity of purpose, stetement of 
criteria, and conditions before aliowing the participating teachers to 
distribute them to the students. The behavioral objectives, after 
approval, were utilized during Condition Two and Condition Four. The 
teachers were instructed also to construct a pretest and a posttest for 
use during Condition Two. Again, these instruments were examined by the 
investigator before they were administered. The teachers were instructed 
to provide all students an opportunity to remediate before beginning e 


new set of objectives. Neither teacher was told the purpysse of the 
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study, and neither of them was given any intormatton regarding the nature 


of the data that were recorded by the observers and the grader, 


Experimentai Design 
The study consisted of four conditions (the first baseline, the 


first treatment, the second baseline, and the second treatment). 

Condition One. Observers recorded benavioral data, ana the grader 
scored academic classwork, homework, and mathematics tests. This 
condition lasted 12 school days. At the end of tnis conditicn both 
teacners were trained to write behaviorai objectives, teach lessons 
derived from the objectives, and to use criterion=-reterenced measure- 
ment. 

Condition Two. The first treatment condition also lasted i2 { 
school days. it was begun with the administration ot a mathematics 
pretest covering a new unit of work for the subjects. Benaviora! 
objectives were distributed daily by the teachers to ai: pupils in tne 
selected classes. Free time was awarded to those pupils who successtul- 
ly completed the assigned objectives for the given day. These pupils 
were also given the option to begin working on the next set or be- 
havioral objectives. Those who were not successfu: in their attempt to 
meet the objectives were given the opportunity to engage in sim‘ lar 
learning activities until they reached the prespecified guais. nen 
they moved to the next set of behavioral objectives. The mathematics 


posttest was administered at the end of this condition. 


Condition Three. The second baseline condition iasted seven i 
school days. The participating teachers were instructed to return to 


their pre-experimental way of instruction. They were reminded to 
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refrain from using behaviorai objectives, criter:on evaiuat’on, or 
remediation procedures. 

Condition Four. The second treatmen: conait on iasted five school 
days. Procedures in this condition were designed to repticate those in 
condi.ion two. An observer reilabi lity testing session was conducted in 


this condition, as weil as in each of the prev’ ous three conditions. 
RESULTS 


Twenty-two eighth grade d*sruptive students trom tour classes pro- 
vided data for ciassroom »‘ehaviors (TR, TO, and DB) anda academic 
achievement (criterion tests) as a Ttunction of the rour conditions of 
the study. These data are presented in Figure i. Tne average percent 
of TR, TO, and DB behaviors *s depicted for each cond:tion. Aiso, 
Figure I shows the mean percent of achievement at measured by criterion 
tests for the two baseline and tne two treatment cond: tions. 

The Friedman (nonparametric) two-way anaiysis of variance test 
(Siegel, 1956) reveaied a signiticent chi-square for three aegrees of 
freedom (15.02, p <.01) for TR benaviors, Post noc anatysis ot these 
data, using tne chi-square analog of Scnetté's Theorem (Marascuiio, 
1971), indicated significant differences (p <.01) between Conditions 
One and Two and between Condicions One and Four. Examination ot 
Figure I reveals that the mean percentage of TR benaviors wes greater 
under Condition Two than during Condition One. The general ieyei of IR 
behaviors established in Condition Two was maintained during Condition 
Three. During Condition Four, the frequency of TR behaviors iricreased, 


establishing a pattern simijar to that of Condition Two. 
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FIGURE I 
MEAN PERCENT OF CLASSROOM BEHAViORS AND 
ACHIEVEMENT OVER THE FOUR CONDITIONS 
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Using the Friedman two-way anaiysis ot variance, TU DeNaviors were 
found to be significantly ditterent (cn-=square 21.64, dt - 3, pe.01).- 
Post hoc analysis indicated significant aitterences tor TU Dehav ors 
between Conditions One and Two (p —.0i), petween Cond:tions One and 
Three (p <..05), and between Conditions One ana Four {p< .O0l). As wth 
TR behaviors, the general leve: of IU behav ors established in Condition 
Two waS maintained tor Condition Three. And during vond.tion Four, the 
frequency of T0 behaviors decreased, establishing a pattern simitar to 
that of Condition Two. There were no significant differences Between 
the last three conditions of the study for IG behaviors. 

The Friedman test for DB behaviors indicated that tor a cn: =square 
of 17.76, with df = 3, a Significant ditference was found (p< Ol). 
Post hoc contrast of these data reveaied difterences :n DB behav: ors 
between Conditions One and Iwo (p <~.05) and between Conait cns One and 
Four (p <.01). Again, inspect’on of Figure 1 indicates tnat the same 
pattern existed for DB as for TR and TO bDenaviors. in other wurds, as 
TR behaviors of the subjects became more treguent, Doth JU enc Oo Dde- 
haviors decreased in frequency, and vice-versa, 

The results of the Frieaman test tor ditferences in academic 
averages indicated that a chi-square of 44.19, dt = 3, waS Sign tT cant 
(p<.01). Post hoc contrasts petween average percent of acnievement 
on criterion tests revealed significant differences (6 <.01; for tne 
following: Conditions One and Two, Ucnditions Une and Four, Conditions 
Two and Three, and Conditions Three and Four, Thus, the average percent 
of achievement on the criterion tests was significantiy higher in butn 
treatment conditions (Two and Four) than during tne baseline conditions 


(One and Three). Also, using tne Wilcoxon Matcned-Pairs test (sizgel, 
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1956), a significant difterene (p< Oj) was found between the pretest 


and posttest administered during the first treatment condition 
DiSCUSSION 


From this investigation 1t waS conciuded tnat the usé ot behaviora! 
objectives and criterion evaluation had a positive effect on the 
classroom grogress of adolescents. it was Tound that teachers were able 
to write behavioral objectives and employ criterion evaiuation so that 
learners reaped greater benefits in that instructional setting than in 
conventional settings. Further, it may be said that the process of 
remediation expanded the opportunity tor iearner: to reach prespecified 
goals, particularly since this process enabied them to recycie their 
learning activities and encouraged success 

Since Time Off Task behaviors did not increase sign’ t.cantiy in 
Condition Three back to the level of those in Cond:tion One, and since 
the achievement levels did decrease ’n Condition Three, it was con- 
cluded that time spent by the subjects pursu'ng a learning goai was not 
nearly as vital to learning as the process by wnicn they were taught, 
Therefore, teacher preparation to utilize behav orsi cbjyectives and 
criterion evaluation emerged as the majcr determinant of academic 
variations. Further evidence was found to support this conclusion when 
the data revealed that diSruptive behaviors were re:atively unaffected 
by experimentation during reversal . 

The lack of Significant difference in ali categories of classroom 
behavior between Condition Two and Condition Three as well as between 
Condition Three and Condition Four is no reai cause for alarm, Since 


Condition Three had a duration of only seven school days and Condition 


ie 
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Four was only five scnoo!i days ‘n !engtn, eftects of tne use St deE- 
havioral opject:ves and criterion évaiuaticn n Cond- tion Two may wel’ 
have carried over into the other cond:t.ons, parliculariy 3°NcCe Mmadvy oF 
the subjects hed experienced such drastic -mproveinent .4 Condition Two 

The significant ditference in I me OFT Task Oenay or: which oc- 
curred between Condition One and Condition Ihree ; the two oase ine 
conditions) indicated that cnhilaren are more wiitting ic .ent:aue fearn= 
ing efforts if teachers are willing to "pay ott" ro: desired benavior. 
The behaviors which appé-ently were re-nforced py a sense of accompiisn- 
ment did not decrease Significantiy toilowing Cond.t on Two. in other 
words, when the uSe of behavicral objectives, criterion evatuation, and 
remediation was eEiiminated in Condition Inree, the subjects continued to 
exhibit a higher rate of Task Reievant behav’ ors while tne’ r Disrupt ve 
Behavior remained essentia‘ly the same. hence, Ind vidue. 2at on ot tne 
instructional process (as SppsSeda to lockstep Classroom procedures, 
apparently served as a strong reinforcer to the subjects. 

It should be empnasized that, essentialiy, fur the first t'me in 
recent years these subjects had experienced substantial academic progress 
in Condition Two. Thus, they apparently were more wilsing to Continue to 
exhibit more Task Reievant behaviors even tnough their rate of Dis- 
ruptive Behavior did not change noticeabiy. This deve:cpment aisc indi- 
cated that an increased amount of time Spent on iearning tasks was not 
the primary consideration. For, a comparison of .léssroum behavior 
patterns and achievement reveaied that achievement 1eveis decreased 
drastically during Condition Three even though the subjects were spend- 
ing more time on learning tasks than tney did in Condition One. since 


the "pay off" (a sense of accomplishment resuiting trom a modificat?on 
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in instruct*onai technique) in Condition Two apparentiy caused Task 
Relevant activity tu cont‘nue atl a more frequent rate in Cond't’ on Inree 
than in Condition One, it was assumed tnat the iackn of cont nued academ < 
gains was not caused by pupi: mispehav'or .0B; or “nattertivn .10), Dut 
by the change :n instructiona: process 

The present investigation utilized benaviorai vdyectives and 
criterion evaluation as means ts increased ‘eveis uf achievement Par ~ 
ticipating teachers tn the stud:es referred to in the tntroduction were 
given a set of behaviora! scbjectives and were snmsivuctled to teach tor 
the achievement of those goals, They seie-ted tneir own processes. in 
the present investigation, however, the participating teathers were 
trained to write and to use behavioral objectives and to empioy cr'+ 
terion evaluatign. Eacn set of daily objectives was Supmitted tu the 
investigator for appreval with regard to clar ty, léveis ut expected 
competency, and conditions. The same procedure was uSed when exam - 
nations were given. Criter‘on evaluation was the source cf measur e- 
ment, and remediation increased the possidiiity of goal attainment 
These contruls which were applied te the use of benhav:ora! objectives 
and criterion evaluation vastiy improved teacner understand ing of the 
process and provided tor uniform manipulation of the ‘independent vari- 
able. Consequentiy, changes in achievement patterns were decisive. 

Of particuiar interest to many is the fact tnat, aitnough no direct 
manipulation was employed to contrai the classroom Dehavior of tne dis- 
ruptive students, TR behaviors increased significantly during treatment 
conditions. And, as the TR behaviors increased in trequency, TO ana DB 


behaviors decreased. 
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